\ 



WORLD INTELLECTUAL PROPERTY ORGANIZATION 
International Bureau 




PCT 

INTERNATIONAL APPLICATION PUBLISHED UNDER THE PATENT COOPERATION TREATY (PCT) 



(51) International Patent Classification 5 
H04N 7A6, 5/445 



Al 



(11) International Publication Number: 
(43) International Publication Date: 



WO 95/12282 

4 May 1995 (04.05.95) 



(21) International Application Number: PCT/US94/08863 

(22) International Filing Date: 4 August 1994 (04.08.94) 



(30) Priority Data: 
143,938 



27 October 1993 (27.10.93) 



US 



(71) Applicant: PRINCETON ELECTRONIC BILLBOARD, INC. 

[US/US]; Suite 500, 47 Huffish, Princeton, NJ 08542 (US). 

(72) Inventors: ROSSER, Roy, Jonathon; Apartment 2, 105 Clar- 

idge Court, Princeton, NJ 08540 (US). WILLIAMS, Brown, 
F.; 27 Honey Brook Drive, Princeton, NJ 08540 (US). 

(74) Agent: PLEVY, Arthur, L.; Plevy & Associates, P.O. Box 
1366, 146 Route 1 North, Edison, NJ 08818-1366 (US). 



(81) Designated States: AU, BR, BY, CA, CN, CZ, HU, JP, KR, 
NZ, PL, PT, RO, RU, European patent (AT, BE, CH, DE, 
DK, ES, rA, GB. GR, IE, IT, LU, MC, NL, PT, SE). 



Published 

With international search report. 
With amended claims. 



(54) Title: DOWNSTREAM CONTROL OF ELECTRONIC BILLBOARD 
(57) Abstract 

A system and method are disclosed for authorizing, con- 
trolling and monitoring the insertion of advertising indicia and 
other video images into a broadcast video stream by an Elec- 
tronic Billboard system (22) operated at a location remote from a 
video program origination location. The disclosed control means 
will be implemented in the form of a user key (15) which is re- 
supplied to an operator of the remote Electronic Billboard system 
(22), a broadcast key (18) supplied to that operator at or near 
the time of transmission of the broadcast video stream, and a 
verification means (25) operated in conjunction with the remote 
Electronic Billboard system (22) to verify that those keys corre- 
spond to a predetermined criterion. Upon such verification, the 
remote Electronic Billboard system (22) is enabled to operate on 
the broadcast video stream. The control means may also be ap- 
plied for maintaining the integrity of either or both the products 
being advertised and the event being broadcast. 
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DOWNSTREAM CONTROL OF ELECTRONIC BILLBOARD 

Technical Field of the Invention 

This invention relates to the use of Electronic Billboard systems 
in relation to television programming, and more particularly to the application 
and control of such systems at locations downstream in a transmission path 
from the originating program location. 

Cross Reference to Related Applications 

This invention is related to the invention disclosed in co-pending 
application, Serial Number 07/826,754, filed January 28, 1992 (Notice of 
Allowance issued July 12, 1993), entitled TELEVISION DISPLAYS HAVING 
SELECTED INSERTED INDICIA, by the inventors herein and assigned to 
the same assignee, as well as a corresponding PCT application of the same 
title, Serial No. U.S. 91/05174, filed July 19, 1991. The invention is also 
related to British Patent Application Serial No. 9102995.9, entitled Electronic 
Billboard: A Method of Advertising Using Existing Television Transmission 
Facilities, filed February 13, 1991 by Roy J. Rosser and Martin Leach (which 
application is based upon a provisional application filed February 14, 1990) 
and to British Patent Application Serial No. 9019770.8, entitled Audio 
Electronic Billboard, filed September 10, 1990 by Roy J. Rosser. 

Background Art 

In the cross-referenced related U.S. application (S/N 
07/826,754), a system and method are disclosed for the dynamic substitution 
of a chosen image or indicia into a preselected portion of an existing video 
image, such as may be depicted in a television program. That system, which 
is characterized as an "Electronic Billboard", operates to detect part or all of 
an object or objects within a video image and to thereafter use the position of 
that object or part thereof as a reference. The Electronic Billboard system 
then operates to replace a portion of the original video image, as identified by 
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the position reference, with another still or video image chosen by the 
operator. The system further operates to position that replacement image in 
exact correspondence with the replaced portion of the original video image, 
such that the final composite image appears to a viewer as though it were the 
5 actual image being recorded by the video camera which created the original 

video image. In other words, the replacement image is seamlessly and 
realistically incorporated into the video image of the original event. Moreover, 
because of the dynamic substitution capability of the Electronic Billboard 
system, the appearance of the replacement image will continuously conform to 

10 the appearance of the original scene when that scene is moved, panned, 
magnified, zoomed, or otherwise altered in size or perspective. 

As also explained in the disclosure for the "Electronic Billboard" 
invention, the pattern recognition software for the invention utilizes the "Burt 
Pyramid" algorithm, which, as is well known to those skilled in the art, is a very 

15 powerful methodology for processing, analyzing, and/or synthesizing video 
signals. Nonetheless, even though such pattern recognition software thereby 
achieves a processing speed which often permits real-time processing for the 
image replacement methodology of the invention, it was noted that, in some 
circumstances, a short time delay may be necessary in the transmission of the 

20 composite video image to accommodate the necessary processing. In such a 
circumstance, a frame-store means would be used with the Electronic Billboard 
in order to temporarily store a small number of video frames, thereby 
incorporating a time delay mechanism into the system. 

In a preferred embodiment of the Electronic Billboard invention, 

25 the video image to be processed is a televised sports event. In such an 

application, the identified portion of the original video image to be replaced 
may be the image of the playing surface, or a portion thereof, and/or 
stationary surfaces which are part of a structure, such as a stadium, proximate 
to that playing surface. With this" embodiment, the replacement image would 

30 typically be an advertising message. A useful example of such a preferred 
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embodiment is a televised tennis match. There the actual video image of one 
or both halves of the tennis court, on which the match is being played, might 
be replaced by use of the Electronic Billboard, such that a viewer of the 
televised tennis match would see an advertisement, as on a billboard, 
5 appearing on the tennis court. It will, of course, be possible to locate the 
replacement image within the bounds of certain marked areas of the court, so 
as not to interfere with the television viewer's ability to determine when a 
tennis ball lands within or without such a marked area, or alternatively, to 
eliminate the substitute image during periods of active play on the court in 
10 question. 

Where a televised program is distributed to a number of remote 
geographic locations, as from a network program origination location to a 
variety of network affiliates, it will, of course, be possible to locate such an 
Electronic Billboard system at the originating site (or the site from which the 

15 original program is electronically distributed), as well as at any position 
downstream from that originating location in the chain of distribution of that 
program to an user. Alternatively, it is possible to separate the Electronic 
Billboard functions of object detection/recognition and of image 
insertion/replacement, and provide two distinct systems, a "master" and a 

20 "slave" system. The "master" system, which does the initial image detection and 
recognition, and is essentially the front-end of the unitary Electronic Billboard 
system, is situated at the broadcast originating location. The second system, 
the "slave", which will be situated at a downstream location, is essentially the 
back-end of the unitary Electronic Billboard system and operates by receiving 

25 and operating on various parameters sent from the master system - in 
particular, information pertaining to the precise location of the inserted image, 
such as the coordinates of the origin of the site at which to locate the image 
to be inserted^and any other data necessary for the slave to successfully carry 
out the insertion of the required replacement image in the proper place and 

30 manner. The parameters passed from master to slave are essentially the same 
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parameters transferred internally in the unitary Electronic Billboard. These 
parameters constitute a small volume of data compared to television signals. 
As such, in the master/slave arrangement, these parameters could either be 
transmitted from master to slave via a separate telephone link tip, or they 
5 could be incorporated in the existing video signal, such as in the vertical 
blanking interval, as is done in the well known teletext broadcast systems, 
exemplified by the British Broadcasting Corporation's Ceefax service. 

The program originator of a program such as described above 
will generally have a right to control the distribution of the program at 

10 downstream locations, particularly with respect to advertising associated with 

such a program. Where such advertising is implemented through an Electronic 
Billboard system by a replacement of portions of the video image of the actual 
program content, as opposed to breaks in the program content, the exercise of 
such a control right becomes a critical concern. 

15 In general, the downstream operator will distribute such a 

program pursuant to a license from the program originator and subject to 
financial obligations associated with such a license. Because the sub- 
distribution rights, and particularly the advertising rights, are likely to vary 
between different downstream operators, it is necessary that a control 

20 mechanism be available to the program originator for assuring compliance by 
each downstream operator with the terms of the particular license arrangement 
existing between the program originator and that downstream operator. 
However, with the unique capabilities of the Electronic Billboard system, there 
are presently no control mechanisms known for adequately protecting a 

25 program originator's rights in the use of such a system. It is, therefore, a 
principal object of this invention to implement such a control mechanism for 
use with the Electronic Billboard system. 

It is expected that the television industry will adopt practices for 
the use of the electronic billboard broadly similar to those already established 

30 for advertising inserted in breaks between programs or program segments. 
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Typically, the existing practice consists of a rights holder to a particular 
program or event transmitting that program or event to other broadcasters 
(downstream broadcasters) for use in their markets. The rights holder may or 
may not include advertising which the downstream broadcaster is required to 
5 broadcast. The downstream broadcaster may or may not have negotiated the 
right to use some or all of the time slots in and between program segments to 
insert advertising of its own, depending on the terms of an agreement (or 
license) between the network or original broadcaster and the downstream 
broadcaster for the use of the program. 

10 As is well known, the television industry is highly dependent on 

the legitimate sharing of programs, whether within a network structure or not. 
Moreover, a critical aspect of these "sharing" relationships is that the actual 
sharing of programs takes place as intended (and as defined by contracts 
between the affected parties). Accordingly, much effort is put into monitoring 

15 what is actually transmitted by all of the broadcasters. With conventional 

broadcasting methods, accounting firms are retained for the task of monitoring 
the broadcasting of the programs, including the advertising content, the 
location of the advertising and the nature of competing advertising, in order 
to determine what programs and advertisements are actually transmitted. 

20 It would of course be possible to apply these conventional control 

and audit techniques to program sharing and advertising implemented through 
an Electronic Billboard system, but the nature of the image substitution 
functionality for an Electronic Billboard system imposes two serious obstacles 
to the use of such conventional methods. First, the image substitutions take 

25 place throughout the entire program and not just at specific breaks, requiring 
that a great deal more broadcast or "air time" be monitored, with a likely 
substantial increase in the cost of such monitoring. Second, the subtle and 
seamless nature of the Electronic Billboard image substitutions can be 
expected to make the monitoring process far more difficult in practice, with 

30 consequent loss of accuracy — possibly a significant reduction in accuracy. 
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To overcome these limitations in an application of conventional 
methodologies to the control and monitoring of downstream 
program/advertising content using an Electronic Billboard, a novel means for 
authorizing, controlling, and monitoring the insertion of advertising indicia and 
5 other video images into the broadcast stream by an Electronic Billboard system 
has been developed and is disclosed herein. The disclosed control means may 
also be applied for maintaining the integrity of either or both the products 
being advertised and the event being broadcast. Additionally, this control 
means will be selectably usable, in conjunction with an Electronic Billboard 
10 system, to create a vertical stratification of the advertising market — such as the 

allowance of only certain modes of operation for the Electronic Billboard 
system, as, for example, the use of the substitution functionality only at times 
when active play is not taking place or only when certain players are or were 
not included in the televised scene. 

15 

Disclosure pf the Invgyitipp 

A system and method for authorization and control of an 
Electronic Billboard system operated at a location remote from a video 
program origination location, and particularly for enabling a program 

20 originator to authorize, and maintain control over the use of such an Electronic 

Billboard system by downstream broadcasters relaying the original program, 
consisting of a user key, presupplied to an operator of the remotely located 
Electronic Billboard system, a broadcast key, supplied to that operator at or 
near the time of transmission of a video program to the remotely located 

25 Electronic Billboard system from the video program origination location, and 
a means operated in conjunction with the remotely located Electronic 
Billboard system for receiving and evaluating that user key and that broadcast 
key, whereby the remotely located Electronic Billboard system is enabled to 
operate on the transmitted video program upon those keys being found to 

30 correspond to a predetermined criteria. 
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Brief Description of the Drawings 

FIG. 1 is a block diagram of an apparatus for providing user and 
broadcast keys to an electronic billboard and monitoring of use of same 
5 according to the invention. 

FIG. 2 is a perspective plan of a television image received by a 
downstream broadcaster showing how an indicia inserted by the program 
originator can be used as an authorized control for the timing, nature and 
positioning of further indicia inserted by the downstream broadcaster. 

10 

Best Mode for Carrying Out the Invention 

The authorization and control means of the invention is 
implemented through a "lock" incorporated in an Electronic Billboard system 
operated at a downstream location which disables the operation of such a 

15 downstream system, preventing it from being used to insert advertising indicia 

into programs received from the program originator, unless unlocked by an 
appropriate key. Such a lock may be implemented as a physical device 
consisting of electronic hardware, or it may be implemented as a software 
routine or any other suitable means of selectively disabling or preventing the 

20 use of the Electronic Billboard. The "key" for enabling operation of the 

downstream Electronic Billboard system may also be implemented as a 
physical device consisting of electronic hardware or it may be implemented as 
a software routine or any other suitable means of "opening" the lock, and 
thereby allowing the use of that downstream system. The key element of the 

25 invention consists of two parts, a first part of which is presupplied to the 
downstream broadcaster (hereafter designated as "the user key") and the 
second part of which is incorporated in the video stream at or close to the time 
of actual broadcast (hereafter designated as "the broadcast key"). Only when 
the two matching keys reach the downstream Electronic Billboard system will 
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the system function in its intended manner and allow the insertion of 
advertising indicia by the downstream broadcaster. 

This method of controlling a downstream Electronic Billboard 
system may be implemented in a variety of ways, some of which also include 
5 automatic monitoring of some or all of the characteristics of the inserted 

indicia. 

In a preferred embodiment of the invention, the user key will be 
supplied on a magnetic or optical diskette, cassette or other physical medium 
or device which is capable of storing information. The diskette or similar 

10 medium representing the user key may be supplied by the equipment vendor 

or by the rights holder of the program and may consist of a number of keys or 
a single key with a length-of-use limit or a number-of-uses limit. The diskette 
or other suitable medium will be inserted into or otherwise attached to the 
downstream Electronic Billboard system at or before the intended time of use 

15 of that system. The matching broadcast key will then be made available at or 
near the time of the program broadcast by the rights holder or its authorized 
agent. The broadcast key may be supplied in electronic form by telephone, by 
physical delivery, transmitted as part of the broadcast or in any other suitable 
way, and may be entered into the downstream Electronic Billboard system 

20 directly in electronic form or through various peripheral devices, such as a or 

keyboard, microphone, telephone modem or any other suitable means. 

In this embodiment, the user key may be implemented as a 
physical device, such as the shape of a diskette, or a part thereof, or markings 
thereon (which may be in machine readable form or otherwise). Alternatively, 

25 it may be implemented through the functioning of a piece of electronic 
hardware attached to or incorporated in the diskette, such as a silicon chip or 
data embedded therein. Or, it may be implemented as software or software 
encrypted data prerecorded on the disk or any other suitable means of 
providing a key on such a diskette. 
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The broadcast key may be an alphanumeric or other sequence 
or code, and may be supplied verbally, or in data or electronic form via third- 
party transmission facilities, such as telephone lines, or via the video signal 
transmitted from the program originator, incorporated for instance in the 
5 vertical blanking signal of the television broadcast. Such a broadcast key may 
also be implemented as an actual part of the video image such as for instance 
an actual logo being inserted by an Electronic Billboard system at an upstream 
location. 

Referring now to FIG. 1 there is shown a block diagram of the 

10 system of the invention, in which there is a depicted a typical tennis court 12 
as illustrative of a sporting event to be televised using the system of the 
invention. The tennis court is shown in perspective and on either side of the 
net separating the court are shown a back court 11 and a forecourt 13. As also 
depicted in FIG. 1 a television camera 14 is deployed and operable for the 

15 purpose of recording the tennis match (or other sporting event). While the 

opposing players are not shown in the diagram, it will be apparent that they 
would be included in a televised broadcast of such an event. The output of 
camera 14 is coupled directly to a television receiver 16 which receives the 
video signal from the camera and provides a display of the televised image 

20 corresponding to the actual image recorded by camera 14. The output from 

camera 14 is also coupled, via conventional video processing equipment 13, to 
conventional broadcasting system 17 for broadcasting of the video signal from 
the camera to the site of a downstream broadcaster, who receives the signal via 
conventional reception system 21. Before rebroadcasting that received signal 

25 to its own audience, the downstream broadcaster may make use of an 
Electronic Billboard system 22 to insert an advertising message or indicia 
supplied from a second image source 24 - which may be a slogan, an image, 
a logo or the like. In accordance with the operation of the Electronic 
Billboard system, that advertising message will be displayed on selected 

30 portions of the tennis court in the image rebroadcast by the downstream 
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broadcaster's transmission system 30. That television signal is received by the 
end user's reception system 31 and displayed on the end user's television set 
29. 

It is to be noted that camera 14 and associated, processing and 
5 broadcasting equipment 13 are conventional components and therefore capable 

of providing a typical, normal, unaltered television signal and display. The 
distribution of the television from the upstream broadcaster, as accomplished 
via transmission/reception system 17 and 21, may be a wireless broadcast, a 
wireless transmission via satellite or a cable system. Such systems for 

10 distributing television signals are well known. The distribution of the television 
signal from the downstream broadcaster to the end user, as accomplished via 
transmission and reception systems 30 and 31, may also be a wireless 
broadcast, a wireless broadcast via satellite or a cable network. 

The control of the downstream Electronic Billboard system 

15 according to the invention is accomplished by means of a two part key, a user 
key 15 and a broadcast key 18, in conjunction with a lock 25 located in the 
downstream Electronic Billboard system. 

As described previously, user key 15 is presupplied to the 
downstream broadcaster and, upon receipt by the downstream broadcaster, will 

20 be entered into user-key acceptor 27. User-key acceptor 27 and user-key 15 

may take a number of forms, including, but not limiting to, information input 
from an electronically-linked peripheral device, a message or a signal 
prerecorded on magnetic or optical diskette to be read into the Electronic 
Billboard system via a well-known floppy disc drive, or a conventional magnetic 

25 video or audio tape to be read in via a conventional tape reader. User-key 15 
may also be implemented in a well-known read only memory (ROM) pack, a 
magnetic strip on a card similar to conventional credit cards, or any other 
electronic, magnetic, optical or physical device on which appropriate 
- information or messages may be recorded, encoded or encrypted in a manner 

30 suitable for reading or deciphering by user-key acceptor 27. In the case where 
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user-key acceptor 27 is a keyboard or a similar well-known input device, such 
as a mouse or trackball, user-key 15 may simply be an alphanumeric code or 
password to be entered by an operator. User-key acceptor 27 may also be 
used to modify or replace information stored in user-key 15 at the time of 
5 transmission, when the Electronic Billboard system is used to incorporate a 
substituted image into the broadcast video signal, for the purpose of 
monitoring what is actually rebroadcast. This recorded information may 
include, but will not be limited to, all or part of such information as the timing 
and length of the insertion, the nature and position of the insertion or 

10 whatever else is deemed appropriate to assist in the monitoring of the 
transmission for checking or enforcing compliance with agreed contracts for the 
use of the electronic billboard. 

Broadcast-key 18 may take several forms, including a sequence 
of commands generated using video processing equipment 13, and will be 

15 supplied to the downstream Electronic Billboard system at or just before the 

broadcast. As previously discussed, broadcast-key 18 may be transmitted to the 
downstream broadcaster as part of the broadcast itself, or it may be supplied 
via a modem and telephone 19 through a conventional telephone line to a 
telephone and modem 20 at the downstream broadcast site. Upon receipt at 

20 the downstream broadcast site it will be relayed into the Electronic Billboard 
system by broadcast-key acceptor 26. The broadcast-key acceptor may be 
implemented as a processor for decoding a broadcast key sent as part of the 
broadcast stream, as a modem or any other suitable means of accepting the 
information from the broadcast-key, or simply as a socket for electrical 

25 connection to the Electronic Billboard system. It may also be that broadcast- 
key acceptor 26 and user-key acceptor 27 are realized in the same physical 
device, as for instance in the case where they are each implemented in a 
keyboard, and both the broadcast-key and the user-key are simply 
alphanumeric codes or passwords. 
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In addition to supplying the broadcast key, the rights holder may 
also provide the material to be inserted by the electronic billboard. Such 
material to be inserted may be provided with the diskette or similar medium 
on which the user key is placed, or on a separate diskette, via telephone, or on 
5 the video channel either prior to the broadcast of the event in which it is to be 

inserted or even during the broadcast. 

Upon receipt of broadcast-key 18 by the downstream broadcaster, 
that key will be used in conjunction with the user-key 15 (already in the 
possession of the downstream broadcaster), to activate lock 25, and thereby 

10 permit the downstream Electronic Billboard system to operate on the received 
video signal to effect a desired video image substitution. As will be 
understood, the essential purpose of Lock 25 is to check for the existence of 
both the broadcast-key 18 and the user-key 15, or the presence of information 
realized from those keys, and to use that existence or information as a basis for 

15 allowing the Electronic Billboard system to function, or to function in a certain 
manner. Lock 25 may be implemented as an electronic circuit or as a software 
routine (or part thereof) in the Electronic Billboard system. 

The two keys, or the information derived from them, may be 
checked against one another or against information stored in the Electronic 

20 Billboard system (or a combination of such checks), to ascertain the 
authenticity of the keys and, as well, the permitted timing or mode of use of 
the Electronic Billboard system. Indeed as will be readily understood, any 
desirable combination of checks and/or authorizations for operation of the 
downstream Electronic Billboard system (including particular modes of such 

25 operation) may be implemented through the functioning of lock 25. The lock 

would thus enable such operation of the downstream Electronic Billboard 
system as its software or hardware determined were authorized, through an 
interface with the main control processor of the Electronic Billboard system. 
A variety of software and/or hardware means for the authorization and control 

30 of other electronic software or hardware will be known to those skilled in the 



WO 95/12282 



PCT/US94/08863 



13 

art of electronic design and programming, and any of such means may be 
implemented to perform this function of the invention. 

The matching of the user key and the broadcast key, as 
performed by hardware or software in the Electronic Billboard system, may be 
5 used either to allow the downstream broadcaster to insert advertising wherever 
deemed appropriate for a given length of time, or it may control the specific 
location and time of display of the inserted advertising. 

As a further enhancement of the invention, lock 25 may be 
implemented such that, upon determining that both keys are present and 
10, operation thereby authorized, an additional function will also be activated 
whereby certain characteristics of the output stream of the Electronic Billboard 
system will be recorded, for the purpose of monitoring the use of that system. 
This monitoring may take the form of recording data on user-key 15 via user- 
key acceptor 27 (for later retrieval from that user key), or of sending data to 
15 the broadcaster via broadcast key acceptor 26 and the chain of communication 

used to deliver broadcast key 18 (or the information contained therein), such 
as the telephone and modem link 20 and 19, for review and/or recording at 
the broadcast site. 

The use of a diskette system to implement the user-key will be 
20 particularly advantageous in regard to such a monitoring function. Monitored 
data, such as the number of insertions, the time and length of insertions, the 
nature of the insertions and even the insertions themselves would be recorded 
on such a diskette system. As part of the agreed contract, these diskettes 
would be returned to one or more of the Electronic Billboard systems vendors, 
25 the accountants, the rights holder or other suitable parties to confirm that the 
contracts agreed to were adhered to. 

Implementation of such a monitoring function using the 
broadcast-key system may include simply a passive monitoring or may be used 
for the purpose of controlling the "sending of the broadcast signal to the 
30 downstream broadcaster by the rights holder. 
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The monitoring function may also be implemented through 
activation of a separate recording device 28, either at the downstream 
broadcaster's site or at some end user site. Such a separate recording device 
may record the entire broadcast stream from the Electronic Billboard system 
5 or it may record aspects of the broadcast relevant to particular Electronic 
Billboard system functions which have been authorized by the rights holder. 
Among such functions which may be monitored are the timing, position, 
duration and nature of the substitute video images to be inserted by the 
downstream broadcaster. 

10 An alternative embodiment of the invention is schematically 

depicted in FIG. 2. In this embodiment the program originator will also use 
an Electronic Billboard system at the source of the broadcast in order to insert 
substitute video indicia for "national" advertising and which substitute indicia 
may also be used for the control of further insertion of advertising in the 

15 program video stream by downstream broadcasters. FIG. 2 shows an event as 
seen by the downstream broadcaster for this embodiment. The event being 
shown once again uses the example of a tennis match, using a tennis court 12 
with two halves 11 and 13. In backcourt 11 an advertising logo has been 
inserted by the program originator, intended for rebroadcast by the 

20 downstream broadcaster on to the television sets of the end users, while in the 
forecourt 13 an indicia has been inserted which may also act as a broadcast-key 
for appropriately authorized downstream users. As can be seen in FIG. 2, one 
possible means for providing the broadcast-key is as a substituted indicia 
advertising the rights-holder, so that non-authorized downstream broadcasters 

25 would merely rebroadcast that advertising for the rights holder on to the 
television sets of the end user. However, authorized downstream broadcasters 
would have a user-key 18 containing information fed into the Electronic 
Billboard system by user-key acceptor 27 and lock 25, enabling the Electronic 
Billboard system to recognize the broadcast key in the substitute image shown 

30 on the forecourt 13. For example, in FIG. 2, the key may be the phrase "ATV" 
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32, while the rest of the three word slogan, "World Tennis Action," may in fact 
be a code to be recognized by the Electronic Billboard system and/or lock 25 - 
- such as by pattern or character recognition, and processed in accordance with 
predetermined intelligence. Illustrative examples of coding to be derived from 
5 the depicted image (forecourt 13) include the following: Word one (reference 
designator 33) may be "World" (as shown) or it may be "International" or it 
might be "Major". Similarly, the word in place two (reference designator 34) 
may be "Tennis" (as shown) or it may be "Sport" and the word in place three 
(reference designator 35) may be "Action" (as shown) or it may be "Live" or 

10 "Exclusive" or "Extravaganza" or "Entertainment" or "Drama" or "Coverage". 
The result is a broadcast key which will appear as a simple slogan to the end 
viewer if not replaced with downstream advertising, but which can be 
recognized by a downstream Electronic Billboard system as a broadcast key 
with 96 possible messages, assuming each of the words could also be left blank. 

15 In a further embodiment of the invention it is possible to 

separate the Electronic Billboard system functions of object 
detection/recognition and of image insertion/replacement, and thereby provide 
two distinct operating systems, a "master" and a "slave" systems. The "master" 
system, which does the initial image detection and recognition, will be situated 

20 at the broadcast originating location. The second system, the "slave", which 
will be situated at a down-stream location, operates by receiving and operating 
on various parameters sent from the master system — in particular, information 
pertaining to the precise location of the inserted image, such as the coordinates 
of the origin of the site at which to locate the image to be inserted, and such 

25 other data as may be necessary for the slave to successfully carry out the 
insertion of the required replacement image in the proper place, time and 
manner. The parameters passed from master to slave are essentially the same 
parameters transferred internally in the unitary Electronic Billboard. These 
parameters constitute a small volume of data compared to television signals. 

30 Thus, in the master/slave arrangement, the parameters could either be 
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transmitted from master to slave via a separate telephone link, or they could 
be incorporated in the existing video signal, such as in the vertical blanking 
interval, as is done in the well known teletext broadcast systems, exemplified 
by the British Broadcasting Corporation's Ceefax service. Authorization and 
5 control of such a slave processor would be carried out in like manner to that 
heretofore described as to operation of an independent remotely located 
Electronic Billboard system. As will be appreciated, downstream locations 
which did not wish to take advantage of the image replacement functionality 
of the slave system would simply distribute the original video image as received 

10 from the master system located at the originating video source. 

Finally, we note that by using properly configured independently- 
operated, remotely-located Electronic Billboard systems and making available 
full information about the location and duration of the video insertion as well 
as the material to be inserted, the system of the invention will allow remote, 

15 unattended operation of such Electronic Billboard systems equipment. 

Although the present embodiments of the invention have been 
described in detail, it should be understood that various changes, alterations 
and substitutions can be made therein without departing from the spirit and 
scope of the invention as defined by the appended claims. 
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Claims 

1. A system for authorization and control of an Electronic 
Billboard system operated at a location remote from a video program 
origination location comprising: 

a user key, presupplied to an operator of said remotely located 
5 Electronic Billboard system; 

a broadcast key, supplied to said operator of said remotely 
located Electronic Billboard system at or near a time of transmission of a video 
program to said remotely located Electronic Billboard system from said video 
program origination location; and 
10 means operated in conjunction with said remotely located 

Electronic Billboard system for receiving and evaluating said user key and said 
broadcast key, whereby said remotely located Electronic Billboard system is 
enabled to operate on said transmitted video program upon said keys being 
found to correspond to a predetermined criteria. 

2. The system of Claim 1 wherein said means for receiving 
and evaluating is implemented as a lock which operates to disable operation 
of said remotely located Electronic Billboard system unless said user key and 
said broadcast key conforming to said predetermined criteria are present. 

3. The system of Claim 2 wherein said lock is realized in 
electronic hardware interconnected with said remotely located Electronic 
Billboard system. 

4. The system of Claim 2 wherein said lock is realized in 
software operated by a processor associated with said remotely located 
Electronic Billboard system. 
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5. The system of Claim 1 wherein said user key is supplied 
in the form of a medium capable of storing information. 

6. The system of Claim 5 wherein said user key is 
implemented in the form of data stored in said medium. 

7. The system of Claim 6 wherein said medium may also 
store data related to operation of said remotely located Electronic Billboard 
system other than said user key data. 

8. The system of Claim 1 wherein said user key is supplied 
in the form of a physical configuration. 

9. The system of Claim 1 wherein said user key is supplied 
in the form of data stored in an electronic device. 

10. The system of Claim 1 wherein said user key is supplied 
in the form of a code to be input to said remotely located Electronic Billboard 
system via an input device connected to said system. 

11. The system of Claim 1 wherein said broadcast key is 
supplied in an electronic form via a path of said transmission of said video 
program. 

12. The system of Claim 1 wherein said broadcast key is 
supplied in an electronic form via a path separate from a path of said 
transmission of said video program. 

13. The system of Claim 1 wherein said broadcast key is 
supplied in an encoded form via a substituted video image inserted in said 
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video program by an Electronic Billboard system operated at said program 
origination location. 

14. The system of Claim 1 wherein said broadcast key is 
supplied in the form of a code to be input to said remotely located Electronic 
Billboard system via an input device connected to said system. 

15. The system of Claim 1 wherein substitute video image 
data for use by said remotely located Electronic Billboard system is supplied 
to an operator thereof from said program origination location. 

16. The system of Claim 15 wherein said substitute video 
image data is supplied via a path of said transmission of said video program. 

17. The system of Claim 15 wherein said substitute video 
image data is supplied via a path separate from a path of said transmission of 
said video program. 

18. The system of Claim 1 wherein video substitution activity 
by said remotely located Electronic Billboard system may be monitored. 

19. The system of Claim 18 wherein said monitoring of said 
video substitution activity is carried out by an essentially simultaneous 
transmission of data respecting said activity via a path of said transmission of 
said video program. 

20. The system of Claim 18 wherein said monitoring of said 
video substitution activity is carried out by an essentially simultaneous 
transmission of data respecting said activity via a path separate from a path of 
said transmission of said video program. 
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21. The system of Claim 18 wherein said monitoring of said 
video substitution activity is carried out by recording data respecting said 
activity on a medium capable of storing such information. 

22. A method for authorization and control of an Electronic 
Billboard system operated at a location remote from a video program 
origination location comprising the steps of: 

presupplying a user key to an operator of said remotely located 
Electronic Billboard system in advance of an intended usage of said system; 

supplying a broadcast key to said operator of said remotely 
located Electronic Billboard system at or near a time of transmission of a video 
program to said remotely located Electronic Billboard system from said video 
program origination location; and 

providing a means operated in conjunction with said remotely 
located Electronic Biilboard system for receiving and evaluating said user key 
and said broadcast key, whereby said remotely located Electronic Billboard 
system is enabled to operate on said transmitted video program upon said keys 
being found to correspond to a predetermined criteria. 

23. The method of Claim 22 wherein said means for receiving 
and evaluating is implemented as a lock which operates to disable operation 
of said remotely located Electronic Billboard system unless said user key and 
said broadcast key conforming to said predetermined criteria are present. 

24. The method of Claim 23 wherein said lock is realized in 
electronic hardware interconnected with said remotely located Electronic 
Billboard system. 
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25. The method of Claim 23 wherein said lock is realized in 
software operated by a processor associated with said remotely located 
Electronic Billboard system, 

26. The method of Claim 22 wherein said user key is supplied 
in the form of a medium capable of storing information. 

27. The method of Claim 26 wherein said user key is 
implemented in the form of data stored in said medium. 

28. The method of Claim 27 wherein said medium may also 
store data related to operation of said remotely located Electronic Billboard 
system other than said user key data. 

29. The method of Claim 22 wherein said user key is supplied 
in the form of a physical configuration. 

30. The method of Claim 22 wherein said user key is supplied 
in the form of data stored in an electronic device. 

31. The method of Claim 22 wherein said user key is supplied 
in the form of a code to be input to said remotely located Electronic Billboard 
system via an input device connected to said system. 

32. The method of Claim 22 wherein said broadcast key is 
supplied in an electronic form- via a path of said transmission of said video 
program. 
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33. The method of Claim 22 wherein said broadcast key is 
supplied in an electronic form via a path separate from a path of said 
transmission of said video program. 

34. The method of Claim 22 wherein said broadcast key is 
supplied in an encoded form via a substituted video image inserted in said 
video program by an Electronic Billboard system operated at said program 
origination location. 

35. The method of Claim 22 wherein said broadcast key is 
supplied in the form of a code to be input to said remotely located Electronic 
Billboard system via an input device connected to said system. 

36. The method of Claim 22 wherein substitute video image 
data for use by said remotely located Electronic Billboard system is supplied 
to an operator thereof from said program origination location. 

37. The method of Claim 36 wherein said substitute video 
image data is supplied via a path of said transmission of said video program. 

38. The method of Claim 36 wherein said substitute video 
image data is supplied via a path separate from a path of said transmission of 
said video program. 

39. The method of Claim 22 wherein video substitution 
activity by said remotely located Electronic Billboard system may be 
monitored. 

40. The method of Claim 39 wherein said monitoring of said 
video substitution activity is carried out by an essentially simultaneous 
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transmission of data respecting said activity via a path of said transmission of 
said video program. 

41. The method of Claim 39 wherein said monitoring of said 
video substitution activity is carried out by an essentially simultaneous 
transmission of data respecting said activity via a path separate from a path of 
said transmission of said video program. 

42. The method of Claim 39 wherein said monitoring of said 
video substitution activity is carried out by recording data respecting said 
activity on a medium capable of storing such information. 
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AMENDED CLAIMS 

[received by the International Bureau on 17 January 1995 (17.01-95); 
original claims 1-4, 7, .10, 14, 15, 18, 22-24, 28, 31, 35, 36 
and 39 amended; remaining claims unchanged (9 pages)] 

1 . A system for authorization and control of an 
Electronic Billboard system operated at a location remote from a video 
program origination location comprising: 

a user key, presupplied to the Electronic Billboard system; 

a broadcast key, supplied to the Electronic Billboard 
system at or near a time of transmission of a video program to the 
Electronic Billboard system; and 

means operated in conjunction with the Electronic 
Billboard system for selectively enabling the Electronic Billboard system 
to operate on said video program to effect a substitution of a chosen 
indicia into a preselected portion of an image existing in said video 
program upon said user key and said broadcast key being found to 
correspond to a predetermined criteria. 

2. The system of Claim 1 wherein said means for 
selectively enabling is implemented as a lock which operates to disable 
operation of the Electronic Billboard system unless said user key and 
said broadcast key conforming to said predetermined criteria are 
present. 

3. The system of Claim 2 wherein said lock is realized in 
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electronic hardware interconnected with the Electronic Billboard 
system. 

4. The system of Claim 2 wherein said lock is realized 
in software operated by a processor associated with the Electronic 
Billboard system. 

5. The system of Claim 1 wherein said user key is 
supplied in the form of a medium capable of storing information. 

6. The system of Claim 5 wherein said user key is 
implemented in the form of data stored in said medium. 

7. . The system of Claim 6 wherein said medium may 
also store data related to operation of the Electronic Billboard system 
other than said user key data. 

8. The system of Claim 1 wherein said user key is 
supplied in the form of a physical configuration. 

9. The system of Claim 1 wherein said user key is 
supplied in the form of data stored in an electronic device. 
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10. The system of Claim 1 wherein said user key is 
supplied in the form of a code to be input to the Electronic Billboard 
system via an input device connected to the system. 

11, The system of Claim 1 wherein said broadcast key 
is supplied in an electronic form via a path of said transmission of said 
video program. 



12. The system of Claim 1 wherein said broadcast key 
is supplied in an electronic form via a path separate from a path of said 
transmission of said video program. 

13. The system of Claim 1 wherein said broadcast key 
is supplied in an encoded form via a substituted video image inserted in 
said video program by an Electronic Billboard system operated at said 
program origination location. 

14. The system of Claim 1 wherein said broadcast key 
is supplied in the form of a code to be input to the Electronic Billboard 
system via an input device connected to the system. 



15. The system of Claim 1 wherein substitute video 
image data for use by the Electronic Billboard system is supplied to an 
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operator thereof from said program origination location. 

16. The system of Claim 15 wherein said substitute 
video image data is supplied via a path of said transmission of said 
video program. 

17. The system of Claim 15 wherein said substitute 
video image data is supplied via a path separate from a path of said 
transmission of said video program. 

18; The system of Claim 1 wherein video substitution 
activity by the Electronic Billboard system may be monitored. 

19. The system of Claim 18 wherein said monitoring of 
said video substitution activity is carried out by an essentially 
simultaneous transmission of data respecting said activity via a path of 
said transmission of said video program. 



20. The system of Claim 18 wherein said monitoring of 
said video substitution activity is carried out by an essentially 
simultaneous transmission of data respecting said activity via a path 
separate from a path of said transmission of said video program. 
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21. The system of Claim 18 wherein said monitoring of 
said video substitution activity is carried out by recording data 
respecting said activity on a medium capable of storing such 
information. 

22. A method for authorization and control of an 
Electronic Billboard system operated at a location remote from a video 
program origination location comprising the steps of: 

presupplying a user key to the Electronic Billboard system 
in advance of an intended usage of the system; 

supplying a broadcast key to*the Electronic Billboard 
system at or near a time of transmission of a video program to the 
Electronic Billboard system from the video program origination location; 
and 

selectively enabling the Electronic Billboard system to 
operate on said video program to effect a substitution of a chosen 
indicia into a preselected portion of an image existing in said video 
program upon said user key and said broadcast key being found to 
correspond to a predetermined criteria. 

23. The method of Claim 22 wherein the step of 
selectively enabling, the Electronic Billboard system is implemented as a 
lock which operates to disable operation of the Electronic Billboard 
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system unless said user key and said broadcast key conforming to said 
predetermined criteria are present. 

24. The method of Claim 23 wherein said lock is realized 
in electronic hardware interconnected with the Electronic Billboard 
system. 

25. The method of Claim 23 wherein said lock is 
realized in software operated by a processor associated with said 
remotely located Electronic Billboard system. 

26. The method of Claim 22 wherein said user key is 
supplied in the form of a medium capable of storing information. 

27. The method of Claim 26 wherein said user key is 
implemented in the form of data stored in said medium. 

28. The method of Claim 27 wherein said medium may 
also store data related to operation of the Electronic Billboard system 
other than said user key data. 

29. The method of Claim 22 wherein said user key is 
supplied in the form of a physical configuration. 
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30. The method of Claim 22 wherein said user key is 
supplied in the form of data stored in an electronic device. 

31. The method of Claim 22 wherein said user key is 
supplied in the form of a code to be input to the Electronic Billboard 
system via an input device connected to the system. 

32. The method of Claim 22 wherein said broadcast key 
is supplied in an electronic form via a path of said transmission of said 
video program. 

33. The method of Claim 22 wherein said broadcast key 
is supplied in an electronic form via a path separate from a path of said 
transmission of said video program. 

34. The method of Claim 22 wherein said broadcast key 
is supplied in an encoded form via a substituted video image inserted in 
said video program by an Electronic Billboard system operated at said 
program origination location. 

35. The method of Claim 22 wherein said broadcast key 
is supplied in the form of a code to. be input to the Electronic Billboard 
system via an input device connected to the system. 
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36. The method of Claim 22 wherein substitute video 
image data for use by the Electronic Billboard system is supplied to an 
operator thereof from said program origination location. 

37. The method of Claim 36 wherein said substitute 
video image data is supplied via a path of said transmission of said 
video program. 

38. The method of Claim 36 wherein said substitute 
video image data is supplied via a path separate from a path of said 
transmission of said video program. 

39. The method of Claim 22 wherein video substitution 
activity by the Electronic Billboard system may be monitored. 

40. The method of Claim 39 wherein said monitoring of 
said video substitution activity is carried out by an essentially 
simultaneous transmission of data respecting said activity via a path of 
said transmission of said video program. 

41. The method of Claim 39 wherein said monitoring of 
said video substitution activity is carried ou an essentially 
simultaneous transmission of data respecting said activity via a path 



AMENDED SHEET (ARTICLE 19) 



WO 95/12282 



32 



PCT/US94/08863 



separate from a path of said transmission of said video program. 

42. The method of Claim 39 wherein said monitoring of 
said video substitution activity is carried out by recording data 
respecting said activity on a medium capable of storing such 
information. 
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